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VALIDATING  ALTERNATIVE  THERAPIES:  ADD-ADHD  STUDY  DESIGNS 

by  Martha  S.  Lappin,  Ph.D. 

Martha  S.  Lappin  received  her  doctorate  in  psychology  from  Michigan  State  University. 
Following  fifteen  years  as  a  research  psychologist  for  the  U.S.  Army  Research  Institute,  she 
entered  the  field  of  alternative  medicine,  serving  first  as  a  research  consultant,  then  as  the 
research  director  for  Energy  Medicine  Developments. 

Dr.  Lappin  has  designed  and  conducted  trials  of  an  experimental  pulsed  magnetic  therapy  for 
migraine  headaches  and  multiple  sclerosis  and  recently  completed  a  large-scale  project  to 
measure  patient  perceptions  of  acupuncture  techniques  and  outcomes.  She  was  the 
coproducer  of  the  1999  conference  “Helping  Kids  with  ADD:  Alternative  Approaches  to  Optimal 
Health”  and  is  the  copublisher  of  a  quarterly  newsletter  of  the  same  name.  She  is  trained  in 
neurofeedback,  a  technique  used  to  treat  thousands  of  children  with  ADD,  and  has  consulted 
with  the  University  of  Washington  on  research  designs  for  alternative  treatments  of  this 
disorder.  Dr.  Lappin  has  coauthored  several  Journal  articles  and  conference  presentations  on 
research  design  and  clinical  trials  of  alternative  therapies  and  recently  received  a  research 
grant  from  the  National  Institutes  of  Health  (NIH)  to  continue  her  work  in  this  area.  Dr.  Lappin 
is  currently  assisting  The  Monroe  Institute  to  develop  NIH  grant  proposals.  She  is  also 
organizing  a  second  conference  on  “Helping  Kids  with  ADD,  ”  to  be  held  October  14  at  George 
Mason  University  in  Fairfax,  Virginia. 

Introduction 

The  goal  of  most  applied  research  projects  is  to  demonstrate  that  a  particular  treatment  or 
intervention  works.  If  someone  has  personally  experienced  or  observed  the  effectiveness  of 
the  treatment  this  is  an  easy  task.  Anecdotal  data  will  be  sufficient  to  confirm  what  they  already 
“know.”  Most  of  the  time,  however,  we  are  interested  in  persuading  a  larger,  often  more 
skeptical  audience  that  a  product  or  treatment  has  value.  What  is  required  for  this  task  is  a 
success  story  that  (a)  clearly  spells  out  the  who,  what,  when,  where,  and  why  of  the  successful 
intervention,  and  (b)  provides  a  strong  basis  for  concluding  that  the  treatment  or  intervention  of 
interest,  not  some  other  factor,  was  responsible  for  the  observed  improvement.  The  purpose  of 
this  paper  is  to  help  practitioners/researchers  design  studies  that  will  accomplish  this.  I  am 
going  to  focus  specifically  on  evaluating  Hemi-Sync®  interventions  in  children  and  adults  with 
attention  deficit  disorder  (ADD)  or  attention  deficit  hyperactivity  disorder  (ADHD).  However,  the 
principles  that  will  be  covered  are  applicable  to  studies  in  any  population. 

Designing  and  conducting  convincing  studies  requires  that  we  think  through  our  objectives  in 
advance,  curb  our  inclination  to  “go  with  the  flow”  instead  of  sticking  to  a  treatment  protocol. 


and  keep  detailed,  meticulous  records.  This  is  difficult  even  for  people  with  years  of  scientific 
training,  so  it’s  understandable  that  people  who  simply  want  to  experience,  enjoy,  and  share 
Hemi-Sync  might  shy  away  from  such  a  daunting  task.  So  why,  then,  do  we  encourage  you  to 
incorporate  research  into  your  practice?  The  answer  is  easy — the  benefits  to  clients, 
practitioners,  and  the  Institute  are  tremendous.  Good  studies  can  uncover  new  applications  for 
Hemi-Sync  and  point  to  ways  of  improving  upon  what  we  are  currently  doing.  They  can  identify 
the  people  most  likely  and  least  likely  to  benefit,  and  the  ways  in  which  the  power  of  the  tapes 
and  technology  The  Monroe  Institute  offers  can  be  enhanced.  Good  studies  are  also 
invaluable  for  spreading  the  word.  Well-written  journal  articles  open  doors  within  the  wider 
professional  community  and  also  open  markets  in  public  and  private  sector  organizations.  In 
short,  good  research  is  good  business,  and  it’s  good  for  people.  And  once  you  get  the  hang  of 
it,  it  can  be  gratifying  and  even  fun. 

There  are  all  kinds  of  research  designs.  Here,  we  will  discuss  four:  qualitative  case  studies; 
single-subject  and  small-group  time-series  designs;  single-group  comparative  studies;  and 
multiple-group  controlled  studies.  We  will  illustrate  each  design  with  a  published  study  that 
employed  the  Hemi-Sync  technology. 

Case  Studies 

Two  fundamental  factors  determine  the  value  of  a  study:  the  relevance,  comprehensiveness, 
and  accuracy  of  the  details  provided  (the  who,  what,  when,  where,  and  why);  and  the 
investigator’s  ability  to  support  cause-effect  arguments  by  ruling  out  alternative  explanations 
for  positive  results.  Establishing  causality  is  the  domain  of  controlled  studies;  exploring  and 
documenting  novel  uses  of  a  technology  is  the  province  of  case  studies.  The  difference 
between  a  scientifically  worthless  anecdote  and  a  valuable  case  study  lies  primarily  in  the  level 
of  detail  reported  and  the  richness  of  the  description. 

The  elements  of  a  good  case  study  include 

•  WHO:  Basic  demographics  of  subject  (e.g.,  age,  sex,  occupation),  subject’s  medical  history 
(diagnosis,  presenting  problem,  symptoms),  and  the  nature  and  results  of  any  prior 
treatments 

•  WHAT:  Details  of  the  specific  treatment  used  in  the  study 

•  WHEN:  When  the  treatment  was  administered,  how  long,  how  often 

•  WHERE:  Treatment  setting  (e.g.,  home,  school,  office) 

•  WHY:  Rationale  for  the  treatment  selected 

•  OUTCOME:  Detailed  description  of  the  results 


Qualitative  Case  Studies 


Case  studies  can  be  either  qualitative  or  quantitative,  depending  on  the  way  the  results  are 
measured  and  reported.  In  complex  cases  where  patients  have  multiple  diagnoses  and/or 
exhibit  a  variety  of  symptoms,  the  practitioner  often  does  not  know  in  advance  exactly  what 
symptoms  or  conditions  may  be  ameliorated  by  the  treatment.  When  this  is  the  case,  the 
qualitative  approach  is  most  appropriate;  i.e.,  you  describe  the  patient’s  condition  and 
symptoms  in  rich  detail,  both  before  and  after  the  intervention. 

Dr.  Suzanne  Morris’s  case  studies  of  children  treated  with  Hemi-Sync  for  oral  feeding 
problems  exemplify  this  approach.  For  example,  in  describing  an  autistic  child’s  response  to 
his  initial  exposure  to  Metamusic®  tapes  (Morris  1998),  Dr.  Morris  says,  “.  .  .  he  accepted  touch 
to  his  hands  and  chest,  initiated  eye  contact  and  smiling,  and  appeared  to  be  calm  and 
peaceful.”  After  the  tapes  were  incorporated  into  an  intensive  week-long,  sensory-based 
treatment  program,  the  child  “continued  to  show  increased  interaction  and  eye  contact,  began 
to  explore  toys,  imitated  his  body  movements  and  facial  expressions  in  a  mirror,  .  .  .  gagging 
and  vomiting  ceased.”  These  descriptions  are  compelling  because  they  describe  specific 
behaviors,  they  are  relevant  to  the  presenting  problem  (rejecting  food),  and  they  accurately 
depict  the  variety  of  changes  observed. 

Case  studies  will  never  convince  the  scientific  community  that  a  certain  strategy  or  intervention 
really  works.  This  is  fine  because  that  is  not  the  purpose  of  a  case  study.  The  purpose  of  a 
case  study  is  to  alert  fellow  practitioners  and  researchers  to  new  possibilities — new  ways  of 
treating  complex,  difficult-to-treat  patients,  new  conditions  or  symptoms  that  might  be 
amenable  to  the  treatment,  and  new  ways  of  combining  treatments.  If  others  obtain  similar 
results,  eventually  someone  will  be  bold  enough  to  see  whether  the  results  stand  up  in  a 
controlled  trial.  If  they  do,  the  scientific  and  medical  communities  will  finally  pay  attention. 

Single-Subject  and  Small-Group  Time-Series  Designs 

Quantitative  case  studies  are  different  from  qualitative  case  studies  in  that  they  generally  focus 
on  a  single  outcome  and  include  some  kind  of  numerical  measurement  of  that  outcome  over 
time.  The  paper  by  Brill  and  Walker  (1985)  illustrates  a  quantitative  case  study.  They  begin 
with  a  detailed  description  of  the  subject,  the  presenting  problem  and  the  treatment  setting, 
and  then  proceed  to  describe  the  nature  and  results  of  the  subject’s  earlier  conventional 
treatment.  Documenting  the  results  of  earlier  treatments  is  valuable  because  it  can 
demonstrate  that  improvements  associated  with  the  Hemi-Sync  intervention  are  not  simply  a 
result  of  someone  paying  attention  to  the  problem.  Finally,  the  authors  describe  the  Hemi-Sync 
intervention  they  used  and  display  quantitative  results  in  a  graph.  Their  graph  tracks  the 
number  of  days  each  week  the  subject  engaged  in  at  least  one  episode  of  self-injurious 
behavior.  The  results  are  quite  convincing  because  the  data  are  objective,  and  they  show  a 


clear  trend  over  time — self-injurious  behavior  continued  throughout  the  conventional  treatment 
period,  then  dropped  off  sharply  during  the  Hemi-Sync  period,  and  stayed  at  the  zero  incident 
level  for  a  year  after  discharge  from  a  residential  unit.  When  data  are  collected  across  multiple 
time  periods  like  this,  you  have  a  time-series  design. 

Collecting  time-series  data  is  an  excellent  strategy  in  small,  single-group  studies  as  well  as  in 
case  studies.  James  Thomas,  PhD  (1988),  was  able  to  show  that  Hemi-Sync  contributed  to 
reduction  of  behavioral  incidents  in  a  small  sample  of  seriously  emotionally  disturbed 
adolescent  girls  because  he  collected  behavioral  incident  reports  for  eight  weeks  prior  to  the 
intervention  as  well  as  during  the  eight  weeks  of  intervention.  Suzanne  Morris,  PhD  (1998), 
also  used  a  time-series  design  in  her  pilot  study  of  developmentally  disabled  children  with  oral 
feeding  problems.  She  not  only  collected  pre-intervention  baseline  data  for  four  to  six  sessions, 
she  also  collected  data  during  two  to  four  control  sessions  in  which  subjects  heard  music  that 
did  not  contain  Hemi-Sync  sounds.  Thus,  she  could  draw  more  definitive  conclusions  about  the 
importance  of  Hemi-Sync  tones  by  comparing  results  to  both  the  baseline  and  the  soothing 
music  treatment  periods. 

As  the  studies  above  illustrate,  if  you  can  hypothesize  in  advance  what  outcome  is  most  likely 
to  be  affected,  it  is  extremely  useful  to  devote  time  prior  to  treatment  to  finding  a  good  measure 
of  that  outcome,  and  to  obtain  pretreatment  baseline  data.  Without  baseline  data  showing  that 
the  condition  or  outcome  was  stable  prior  to  the  intervention,  and/or  follow-up  data  showing 
that  the  outcome  returned  to  its  previous  level  after  the  treatment  was  withdrawn,  it  is  very 
difficult  to  convince  others  that  the  target  intervention  was  responsible  for  the  observed 
changes. 

Single-Group  Comparative  Studies 

Another  approach  that  is  especially  useful  in  exploratory  studies  is  a  comparison  of  the  effects 
of  two  or  more  treatments  in  a  single  group  of  subjects.  This  type  of  study  is  sometimes  called 
a  crossover  design  because  subjects  “cross  over”  from  one  treatment  condition  to  the  other. 

Robert  Sornson’s  evaluation  (1999)  of  the  tape  preferences  of  children  with  attention  deficit 
disorder  (ADD)  is  a  good  example  of  this  approach.  Sornson  recruited  eighteen  children,  aged 
six  to  fourteen  years,  all  of  whom  had  been  diagnosed  with  ADD.  The  subjects  were  asked  to 
listen  to  three  different  tapes  over  the  course  of  three  weeks.  Parents  were  asked  to  document 
how  many  times  each  tape  was  used  (subjects  were  to  listen  to  each  tape  at  least  three  times), 
and  to  record  any  changes  they  observed  in  the  child,  during  or  after  the  listening  sessions. 
Parents  were  also  responsible  for  making  an  overall  assessment  of  which  tape  the  child  liked 
best  and  which  one  seemed  best  for  helping  the  child  stay  focused. 

The  purpose  of  the  study  was  to  evaluate  reactions  to  three  different  patterns  of  Hemi-Sync 
tones  (8  and  12  Hz;  8,  16,  and  24  Hz;  and  12  and  16  Hz)  embedded  in  a  musical  score  called 


Heart  Zones  (The  Institute  of  HeartMath,  Boulder  Creek,  Calif.).  The  tapes  were  labeled  simply 
A,  B,  and  C,  and  were  presented  in  random  order  to  keep  families  “blind”  to  the  treatment 
condition  (i.e.,  they  didn’t  know  which  frequency  pattern  they  were  listening  to  that  week)  and 
to  rule  out  order  effects  (e.g.,  a  tendency  to  favor  the  first  or  last  tape,  or  to  prefer  one  pattern 
only  when  it  follows  another).  The  parental  assessments  indicated  a  clear  preference  for  the 
12  and  16  Hz  tape  in  this  group  of  subjects.  Included  in  the  paper  were  parents’  comments  and 
observations  supporting  their  assessments  and  illustrating  the  specific  mood  and/or  behavioral 
changes  they  observed. 

This  study  is  important  for  two  reasons.  First,  it  provides  practitioners  and  researchers  with  an 
empirical  basis  for  selecting  tapes  for  children  with  attentional  problems.  Second,  it  supports 
hypotheses  derived  from  research  on  the  brain-wave  patterns  ADD  children  tend  to  exhibit. 
Often,  children  with  ADD  demonstrate  unusually  slow  brain-wave  activity,  with  a  higher  than 
normal  theta  to  beta  ratio.  Neurofeedback  training  for  ADD  typically  focuses  on  decreasing 
theta  activity  (4  to  7  Hz)  and  increasing  beta  activity  (12  to  18  Hz).  Listening  to  Hemi-Sync 
tapes  with  tones  in  the  beta  range — the  12  and  16  Hz  patterns  preferred  in  Sornson’s  study — 
-may  have  the  same  type  of  effect  on  brain-wave  activity,  thereby  facilitating  one’s  ability  to 
focus  and  concentrate. 

Critical  Elements  of  Research  Design 

As  interesting  and  informative  as  the  studies  described  above  might  be,  the  “gold  standard”  in 
research  is  the  randomized,  double-blind,  placebo-controlled  trial.  What  is  it  about  controlled 
trials  that  makes  scientists  pay  attention?  Earlier  we  said  that  the  quality  of  a  study  depends  on 
two  things:  the  detail  and  accuracy  of  the  descriptions  (the  who,  what,  when,  where,  and  why) 
and  how  successfully  the  study  rules  out  alternative  explanations  for  the  results.  The  primary 
purpose  of  a  randomized,  double-blind,  placebo-controlled  trial  is  to  rule  out  alternative 
explanations  for  observed  effects. 

Alternative  explanations  for  positive  results  in  studies  that  do  not  incorporate  adequate  controls 
include 

a.  Maturation  -  Subjects  outgrew  the  problem  or  it  resolved  on  its  own. 

b.  Attention  effects  -  Outcomes  changed  because  attention  was  focused  on  them.  Subjects 
were  made  more  aware  of  problem  behaviors  by  having  them  measured. 

c.  Spurious  treatment  factors  -  Changes  were  due  to  aspects  of  the  treatment  or  treatment 
setting  unrelated  to  the  specific  intervention  under  evaluation  (e.g.,  a  supportive  relationship 
was  established  or  the  music  was  relaxing). 

d.  Desire  to  piease  the  investigator  -  The  patient  wanted  to  please  the  therapist  by  meeting  his 
or  her  performance  expectations. 


e.  Subject  hopes  and  expectations  -  The  patient’s  own  positive  expectations  or  beliefs  about 
the  treatment  (the  placebo  effect)  produced  the  changes. 

f.  Investigator  bias  -  The  practitioner  or  researcher  had  a  conscious  or  unconscious  tendency 
to  make  observations  and  interpretations  that  were  consistent  with  the  desired  result. 

g.  Idiosyncrasies  of  the  sample  -  By  chance  or  design,  the  treatment  group  consisted  of  people 
who  were  not  representative  of  the  group  to  whom  you  wanted  to  generalize. 

h.  Chance  -  Random  fluctuations  in  behavior  just  happened  to  favor  the  treatment  group  and 
are  unlikely  to  be  replicated. 

Although  it  may  seem  obvious  to  practitioners  and  patients  that  an  observed  improvement  was 
due  to  the  treatment,  critics  are  unlikely  to  agree  unless  the  research  incorporates  design 
factors  that  rule  out  such  alternative  explanations.  This  is  the  value  of  a  well-designed, 
randomized,  controlled  trial. 

So  how  do  control  groups  and  good  research  designs  address  the  problem  of  causality? 
Basically,  they  do  so  by  showing  that  another  group,  treated  identically  except  for  the  chosen 
intervention,  did  not  improve  as  much  as  the  treatment  group  of  interest.  To  demonstrate  this 
you  must  attend  to  a  number  of  factors  in  designing  and  conducting  your  study.  These  factors 
include 

a.  recruiting  subjects  based  on  well-defined  inclusion  and  exclusion  criteria; 

b.  assigning  subjects  randomly  to  groups,  or  matching  groups  according  to  variables  deemed 

c.  likely  to  affect  outcomes  (e.g.,  intelligence,  age,  problem  severity); 

d.  blinding  subjects  to  the  treatment  condition,  or  including  comparison  groups  that  have  an 
equal  probability  of  success  in  the  eyes  of  both  subjects  and  investigators; 

e.  ensuring  that  all  groups  are  treated  identically  except  for  the  specific  factor(s)  you  are  trying 

f.  to  evaluate; 

g.  collecting  both  pre-  and  post-test  data; 

h.  using  reliable  and  valid  data  collection  instruments  and  methods; 

i.  conducting  the  appropriate  statistical  analyses;  and 

j.  ensuring  that  you  have  adequate  statistical  power — a  large  enough  sample  size — to  detect 
treatment  effects  in  the  statistical  analyses. 

Multiple-Group  Controlled  Trials 

A  paper  published  by  Lane,  Kasian,  Owens,  and  Marsh  (1998)  provides  an  excellent  and  very 
relevant  example  of  a  double-blind,  controlled  trial.  In  this  study,  all  subjects  participated  in 
three  treatment  sessions:  a  preliminary  training  session  using  a  pink  noise  tape  with  no 
embedded  tones,  a  thirty-minute  session  with  a  1 .5  and  4  Hz  binaural-beat  tape  (delta/theta 
condition),  and  a  thirty-minute  session  with  a  16  and  24  Hz  tape  (beta  condition).  Analyses 
compared  vigilance  performance  task  scores  across  the  two  treatment  conditions,  as  well  as 


changes  in  mood  states  before  and  after  each  session.  Results  showed  that  the  subjects 
(twenty-nine  adult  volunteers)  performed  better  on  the  vigilance  task  and  experienced  less 
fatigue  and  confusion  when  they  listened  to  the  beta  binaural-beat  tape.  These  findings 
supported  the  authors’  hypotheses  and  are  consistent  with  earlier  research  suggesting  that 
beta  tones  and  increased  EEG  activity  in  the  beta  frequency  range  are  associated  with 
enhanced  attention  and  cognitive  performance.  Like  Sornson’s  study,  this  research  supports 
the  proposition  that  Hemi-Sync  tapes  are  a  simple  and  effective  way  to  affect  brain-wave 
activity  and  states  of  consciousness. 

Another  approach  to  this  study  would  have  been  to  create  three  different  treatment  groups  and 
compare  results  across  groups.  The  crossover  design  selected  by  Lane  et  al.,  however,  is 
much  more  efficient.  When  you  do  not  expect  effects  from  one  treatment  session  to  carry  over 
to  the  next,  a  crossover  study  can  essentially  double  your  analysis  sample,  thus  increasing  the 
study’s  power  with  little  additional  expense. 

Where  to  Start 

If  you  are  contemplating  a  study,  you  must  first  come  up  with  a  preliminary  design.  The  next 
step  is  personally  contacting  fellow  researchers  or  practitioners  who  have  used  similar 
designs,  measures,  and  samples.  Experience  is  a  great  teacher,  and  it  is  prudent  to  take 
advantage  of  what  others  have  learned  about  the  inevitable  pitfalls  and  problems  encountered 
in  research.  It  is  also  wise  to  consult  with  a  statistician  or  design  expert  prior  to  finalizing  the 
study  proposal  to  make  sure  that  the  sample  size,  outcome  measures,  and  planned  analyses 
are  appropriate  for  your  objectives.  Someone  at  a  local  university  may  be  willing  to  collaborate 
on  the  design  and  analysis  components  of  your  study  in  exchange  for  shared  authorship  on  a 
paper  or  presentation.  Finally,  keep  in  mind  that  the  larger  goal,  good  research — whether  you 
do  a  qualitative  case  study,  a  time-series  analysis,  or  a  controlled  trial — will  benefit  the  people 
we  aim  to  serve,  even  if  the  proposed  hypotheses  are  not  supported.  Every  systematic 
evaluation  of  a  promising  new  therapy  enhances  our  ability  to  understand  and  optimize 
interventions  for  health  and  well-being. 
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